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ABSTRACT 


This  report  compares  the  performance  of  two  algorithms  in  correlating  observa¬ 
tions  from  multiple  sensors.  This  correlation  problem  can  be  treated  as  an  assignment 
problem  in  operations  research,  with  assignment  costs  being  equal  to  the  sufficient  statistic 
of  the  generalized  likelihood  ratio  test  In  sensor-to-sensor  correlation,  the  main  concern 
is  a  one-to-one  solution  in  which  targets  from  one  sensor  are  matched  in  an  optimal 
manner  with  targets  from  die  other  sensor.  This  corresponds  to  a  classical  assignment 
problem  that  is  often  solved  using  Munkres’  algorithm.  In  target  object  mapping,  concern 
shifts  to  correctly  associating  a  subset  of  high-value  targets  between  sensors.  We  hypoth¬ 
esize  that  this  goal  could  be  better  attained  by  allowing  for  a  many-to-one  solution  and 
propose  the  use  of  a  modified  auction  algorithm  to  solve  this  generalized  assignment 
problem.  Results  of  Monte  Carlo  simulations  of  such  situations  are  analyzed  to  compare 
the  performance  of  the  two  solution  methods. 
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1.  INTRODUCTION 


Several  specific  problems  arise  in  target  tracking  t^lications.  One  problem  is  the  case  in  which 
multiple  sensors  simultaneously  trade  a  number  of  targets,  often  referred  to  as  multiple  target  tracking. 
Though  multiple  target  tracking  has  other  problem  areas,  we  will  spedfically  discuss  the  correlation  of 
measurements  from  several  sensors  assodated  with  the  same  target 

The  usual  assumption  in  sensor-to-sensor  correlation  problems  is  that  the  locations  of  the  targets  are 
uncorrelated.  In  other  words,  it  is  assumed  that  there  is  a  unique  one-to-one  assodation  between  targets 
observed  by  both  sensors,  and  the  payoff  for  correctly  assigning,  or  correlating,  each  target  is  the  same.  In 
many  practical  tracking  problems  these  assumptions  do  not  hold.  For  example,  when  real  sensor  resolution 
effects  are  considered,  two  objects  that  are  tracked  as  separate  targets  by  one  sensor  may  be  umesolved  and 
correspond  to  a  single  trade  file  in  the  other  sensor.  In  this  case,  the  assumption  of  a  one-to-one  correspon¬ 
dence  between  tracks  is  violated.  Another  example  occurs  when  tracking  targets  in  clutter  or  debris.  Here 
the  payoff  for  correlating  high-value  targets  such  as  missiles  or  aircraft  is  much  greater  than  for  correctly 
correlating  extraneous  debris  trades. 

A  set  of  sensor  tracks  and  assodated  target  identifications  is  known  as  a  target  object  mapping.  Target 
object  moping  is  a  special  case  of  the  sensor-to-sensor  correlation  problem  in  which  a  selected  subset  of 
high-value  targets  is  correlated  between  sensors.  It  is  often  more  important  to  assodate  the  high-value  target 
observed  by  sensor  1  with  the  high-value  target  observed  by  sensor  2,  even  if  additional  targets  observed  by 
sensor  two  are  associated  with  that  sensor-one  target  The  focus  of  this  paper  will  be  to  consider  new 
algorithms  that  effidently  solve  some  target  object  mapping  problems  and  compare  the  new  algorithms  to 
more  conventional  algorithms  for  sensor-to-sensor  correlation. 

For  the  case  of  unique  one-to-one  target  assodation,  it  has  been  shown  that  the  sensor-to-sensor 
correlation  problem  is  the  same  as  the  classical  assignment  problem  in  operations  research  [1-3].  The  costs 
(or  performance  ratings)  used  for  assodation  can  be  shown  to  be  the  sufficient  statistic  of  the  multiple 
hypothesis  generalized  likelihood  ratio  test  [1].  Under  the  correct  hypothesis  for  Gaussian  uncertainty 
models,  the  sufficient  statistic  follows  the  chi-square  distribution.  The  classical  assignment  problem  has 
customarily  been  solved  using  Munkres’  algorithm  [3],  although  more  effident  algoritiims  have  been 
proposed  to  reduce  computatirai  times  for  jMoblems  of  large  dimension  [4]. 

In  this  work,  target  object  mapping  is  treated  as  a  generalized  assignment  problem  in  which  multiple 
assignments  are  allowed.  The  targets  are  assigned  to  minimize  the  total  wei^ted  distance  between  tracks 
of  the  two  sensors.  The  distance  measure  is  based  on  a  Gaussian  uncertainty  model.  The  auction  algorithm 
as  developed  by  Bertsekas  [5]  will  be  used  to  solve  the  generalized  assignment  problem. 

In  Section  2,  we  derive  a  correlation  cost  model  from  a  generalized  likelihood  ratio  test,  as  in  [1].  In 
Section  3,  we  define  the  classical  and  generalized  assignment  problems.  In  Section  4,  we  introduce  our 
solution  methods,  Munkres’  algorithm  and  the  auction  algorithm.  In  Section  S,  we  formulate  a  target  object 
moping  problem  and  develop  a  basis  for  simulation.  Finally,  in  Section  6,  we  use  Monte  Carlo  simulation 
to  evaluate  six  performance  measures. 
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2.  CORRELATION  COST  MODEL 


The  correlation  costs  are  derived  fifom  a  generalized  likelihood  ratio  test,  following  a  similar 
derivation  given  in  [1]. 

Let  xi  be  the  measurement  from  sensor  1,  and  yj  be  the  /*  measurement  from  sensor  2,  where 
the  two  sensors  take  measurements  on  the  same  N  targets.  Assume  that  there  are  m  measurements  from 
sensor  1  and  n  measurements  from  sensor  2.  Assume  for  now  that  m  =  n,  so  that  each  sensor  provides 
measurements  on  the  same  m  =  n  =  N  targets.  The  more  general  problem  in  which  target  sets  observed 
by  each  sensor  are  not  identical  is  shown  as  an  example  of  a  sensor- to-sensor  correlation  problem  in  Figure  1 
and  wiU  be  discussed  shortly. 
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Figure  1.  A  sample  sensor-to-sensor  correlation  problem. 


It  can  be  assumed  that  all  and  jj  are  referred  to  the  same  Cartesian  coordinate  system,  even  though 
sensors  1  and  2  are  not  reqitired  to  be  identical.  If  the  measurements  are  not  of  the  same  coordinate  system, 
a  required  transformation  can  be  defined  to  satisfy  the  above  assumption.  Let  the  covariance  of  the 
measurement  noise  for  sensors  1  and  2  be  represented  by  and  Zy  ,  resp)ectively.  This  can  be  thought  of 
as  the  uncertainty  of  measurement  i  from  sensor  1  and  j  from  sensor  2. 
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Let  denote  the  hypothesis  that  the  same  target,  k ,  has  generated  measurements.  Note  that  there 
are  a  total  of  possible  hypotheses.  Let  z  represent  the  true  measurement  vector  corresponding  to  . 
Then  the  generalized  likelihood  ratio  test  requires  the  following  decision  function  [6]; 

This  decision  function  is  obtained  using  the  maximum  likelihood  estimate  of  z ;  that  is,  the  z  satisfying 


max 

z 


(2) 


The  decision  function  is  then  found  by  substituting  z  into  Equation  1.  Equations  1  and  2  form  the  sufficient 
statistic  for  correlation  measurements  from  multiple  sensors. 

Assume  that  measurement  noise  is  independent  between  sensors  and  follows  a  Gaussian  density 
function  with  zero  mean.  Further  assume  the  covariance  for  sensor  1  is  identically  equal  to  F  for  all 
observations  i  and  the  covariance  for  sensor  2  is  identically  equal  to  £  for  all  observations  j .  Then  the 
decision  function  from  Equation  1  becomes 


+  (>4  -  -  *)] 

d(x.^,yj^)  =  ce 


(3) 


where 


z  =  (F'‘  +  I +  .  (4) 

The  z  in  Equation  4  is  the  maximum  likelihood  estimate  of  z  assuming  that  all  x-^,  yj^  are  uncorrelated. 

Referring  to  Equation  4  for  z ,  the  decision  function  in  Equation  3  can  be  simplified  as  follows.  First 
note  that 

x.^-z  =  (i:p-\l)~\x.-yjJ  .  (5) 

This  follows  from  direct  substitution.  From  this,  one  can  see  the  following: 

-  2)  -  z)  =  (x,.^  -  yj/cL  +  Ff  V(2:  +  Ff^x^^  -  yj^)  .  (6) 

Similarly,  one  can  arrive  at 

iyj^-zfir\yj-z)  =  iXi^-yj/iP  +  i:)-^i:iP  +  I.)-\xi^-yj^)  .  (7) 
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Rnally,  substituting  Equations  6  and  7  into  the  decision  function  in  Equation  3,  one  obtains 


(8) 


All  decision  infonnation  is  contained  in  the  exponent  of  yj^) .  Thus  the  exponent  of  this  decision 
function  is  the  sufficient  statistic  for  the  generalized  likelihood  ratio  test: 

hj  =  y/(P  +  2:)-*  (X,-  -  yj)  .  (9) 

This  value  can  be  interpreted  as  a  weighted  distance  measure  between  observations  x-  and  yj .  If 
observations  x,  and  yj  do  result  from  the  same  tai^et,  then  follows  a  chi-square  distribution,  with 
degrees  of  freedom  equal  to  the  observation  vector  size  [7].  If  x,-  and  yj  do  not  result  from  the  same  target, 
(x,  -  yp  is  not  zero  mean.  In  this  case,  has  a  higher  probability  of  achieving  values  significantly  larger 
than  that  of  a  chi-square  random  variable.  This  statistical  realization  allows  the  use  of  chi-square  statistics 
in  selecting  a  threshold  to  prescreen  l^j ’s.  We  will  see  that  this  can  be  used  in  a  preliminary  manner  to 
effectively  eliminate  ’s  tiiat  indicate  that  x,-  and  yj  should  not  be  associated. 

To  restate  the  problem,  suppose  one  would  like  to  decide  which  x,-  should  be  correlated  with  a 
particular  yj .  In  other  words,  for  a  particular  observation  from  sensor  2,  which  observation  from  sensor  1 
is  most  likely  to  have  originated  from  the  same  target?  For  a  fixed  j ,  this  generalized  multiple  hypothesis 
testing  procedure  will  select  that  x,-  that  satisfies 


“*“*  I-.:  for  a  given  j  .  (10) 

This  value  of  x,-  is  the  best  match  to  target  j  independent  of  all  other  target  matches.  In  the  next 
section  we  will  consider  two  assignment  problems  that  corresporxl  to  a  global  match  of  targets  that  minimiz¬ 
es  the  sum  of  over  all  indices  i  and  j . 
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3.  ASSIGNMENT  PROBLEMS 


A  commonly  used  example  of  an  assignment  problem  is  the  instance  in  which  one  has  m  people  and 
n  jobs,  where  m  does  not  necessarily  equal  n .  There  is  a  certain  cost  (or  benefit),  c,y ,  of  assigning  person 
I  to  job  j .  Which  persons  should  be  assigned  to  which  jobs  to  ensure  that  the  total  assignment  cost  is  min¬ 
imal  (or  that  benefits  are  maximal)?  Two  possiUe  solutions  to  this  problem  are  a  one-to-one  assignment,  in 
which  each  person  is  assigned  to  work  on  exactly  one  job,  and  a  many-to-one  assignment,  in  which  each 
person  may  work  on  more  than  one  job. 

Consider  the  assignment  problem  cost  matrix  shown  in  Table  1 . 


TABLE  1 

Assignment  Problem  Cost  Matrix 


Sensor  1  Observations  ys^ 

Sensor  2  Observations 

^2 

... 

rrl 

>1 

^11 

-  iml 

>2 

hi 

^22 

—  ^m2 

hn 

hn 

^mn 

Recall  that  is  the  sufficient  statistic  associated  with  correlating  observation  i  from  sensor  1  with  obser¬ 
vation  j  from  sensor  2,  as  derived  in  Equation  9.  We  can  treat  l-j  as  the  cost,  c,y ,  of  associating  x-  and  yj . 

3.1  CLASSICAL  ASSIGNMENT  PROBLEM 

In  the  classical  assignment  problem,  l-j  would  represent  the  cost  (or  benefit)  of  assigning  person  i  to 
work  on  the  f'  job.  The  optimum  assignment  is  that  which  can  minimize  the  total  assignment  costs,  subject 
to  the  constraint  that  each  person  be  assigned  to  exactly  one  job: 


rmn  y ,  f 
L  i  ^ 

^JlyJ 


N 


S.LX/,y.=  l;Vy=l,...A^ 


1  =  1 


N 


£/.y.=  l;V/=l,...A^ 

y=i 


(11) 
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where  f-j  are  binary  variables  that  indicate  whether  person  i  is  assigned  to  job  j .  The  problem  defined  in 
Equation  11  assumes  that  there  are  an  equal  niunber  of  jobs  and  people,  i.e.,  m  =  n  ~  N,  and  yields  a 
one-to-one  assignment 

An  obvious  but  unwieldy  way  of  treating  this  problem  is  to  enumerate  all  possible  assignment  sets 
and  then  select  the  one  that  yields  the  minimum  sum.  This  approach  requires  N\  trials.  A  well-known 
method,  the  Hungarian  algorithm,  requires  substantially  fewer  operations  to  reach  an  optimal  solution.  An 
implementation  of  the  Hungarian  algorithm  was  developed  by  Munkres  [3],  which  requires  O(I^) 
operations.  For  large  N ,  this  represents  a  significant  savings. 

The  case  that  m^n  is  the  generalized  assignment  problem.  To  a  certain  degree,  this  can  still  be  con¬ 
sidered  and  treated  as  a  classical  assignment  problem.  Without  loss  of  generality,  consider  the  case  in  which 
m<n,  i.e.,  there  are  more  jobs  than  people.  The  objective  function  in  Equation  1 1  remains  the  same,  but  the 
constraint  set  is  slightly  modified  to  require  that  each  person  may  only  be  assigned  once,  so  that  there  is  still 
a  one-to-one  assignment  Thus  there  will  be  (n  -  m)  jobs  that  will  remain  unassigned. 

Munkres’  algorithm  can  be  modified  slightly  to  solve  this  more  general  assignment  problem.  It 

3 

provides  an  optimal  solution,  assummg  the  above  constraints,  and  requires  0(m  )  operations.  This  has 
already  been  implemented  [8],  and  the  details  will  not  be  included  in  this  report  Currently,  Munkres’ 
algorithm  is  the  method  that  is  most  often  used  to  solve  sensor-to-sensor  correlation  problems  [9]. 

32  MULTIASSIGNMENT  PROBLEM 

An  alternative  way  of  considering  the  generalized  assignment  problem,  in  which  there  are  an  unequal 
number  of  people  and  jobs,  is  the  multiassignment  problem.  The  objective  function  remains  the  same,  and 
each  job  will  only  be  assigned  to  one  person.  However,  each  job  will  be  assigned  to  some  person,  so  each 
person  may  have  more  than  one  job  assignment  (each  job  must  be  done): 


mm  \  I  f 

i,j 


s.t.  i:V;  =  1 . n 


i=  1 


X/y=i;Vi=i . 

y  =  i 


m 


(12) 


This  version  of  the  problem  yields  a  many-to-one  assignment  A  good  solution  to  this  problem,  known  as 
the  auction  algorithm,  is  found  in  [5]. 

The  auction  algorithm  can  be  used  to  solve  all  three  versions  of  the  assignment  problem  using  the 
same  techniques,  as  long  as  m  and  n  are  specified.  The  user  may  extract  either  a  one-to-one  solution  or  a 
many-to-one  solution.  If  the  association  costs  are  integral,  the  solution  provided  by  auction  is  optimaL  The 
auction  algorithm  also  solves  a  large  problem  with  significantly  smaller  computational  complexity. 
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O(nmlogm) .  The  problems  discussed  in  this  paper  are  small  enough  that  computation  time  is  negligible, 
although  some  computation  time  comparisons  for  large-scale  problems  can  be  fotmd  in  [10]  and  [11]. 
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4.  SOLUTION  METHODS 


4.1  MUNKRES’ ALGORITHM 

The  Munkres’  algorithm  itself  will  not  be  discussed  in  detail  in  this  report.  An  existing  FORTRAN 
implementation  that  had  been  modified  to  solve  the  classical  assignment  problem  for  m  ^  n  was  used  [8]. 
One  need  only  provide  m  and  n ,  the  number  of  observations  for  each  sensor,  and  the  calculated  correlation 
costs.  Figure  2  is  given  here  as  the  most  basic  representation  of  Munkres’  algorithm. 
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Figure  2.  Flowchart  for  Munkres'  algorithm. 


42  AUCTION  ALGORITHM 

As  the  name  implies,  the  auction  algorithm  can  be  described  in  terms  of  an  auctiore  Most  of  the 
intuition  provided  in  the  following  section  is  taken  ftom  [5].  It  is  repeated  here  with  minor  alterations  in 
notation  and  terminology  to  facilitate  better  understanding  of  the  initialization  values  and  modifications 
specific  to  this  application. 
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A  common  terminology  must  be  defined.  The  problem  defined  in  Equation  12  can  be  restated  as  a  min¬ 
imum  cost  flow  problem: 


min 


hj  i^j 


S.t  '^fij=  l:Vj  =  1,  ...,n 

1  =  1 


I'--'” 

r=l 

m 

'^fsi  =  n-m  , 

1  =  1 


(13) 


where  fij  and  are  binary  variables  indicating  flow  of  1  or  0,  depending  on  whether  person  node  i  is 
correlated  with  job  node  j .  A  source  node  s  has  been  added  to  the  network.  This  source  node  is  connected 
to  each  person  node  i  by  an  arc  {s,  i)  of  zero  cost  and  feasible  flow  range  [0,  n-m]  (see  Figure  3). 
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Figure  3.  Assignment  problem  network. 
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Define  a  price  vector  pj ,  which  is  the  dual  variable  associated  with  the  constraint  of  the  first  set 
of  constraints  in  Equation  13.  This  can  be  thought  of  as  the  price  that  must  be  paid  for  job  j.  Similariy, 
define  a  profit  vector  it- ,  which  is  the  dual  variable  associated  with  the  constraint  of  the  second  set  of 
constraints  in  Equation  13.  This  represents  the  profit  that  person  i  wiU  receive  for  any  job.  Denote  the  dual 
variable  associated  with  the  last  constraint  in  Equation  13  as  X ,  the  maximal  initial  person  profit 

For  the  sake  of  computational  convergence,  define  a  constraint  e ,  which  represents  the  minimum  bid 
increase.  This  ensures  that  bidding  will  always  increase  the  price  of  a  job.  This  bid  increase  must  be  large 
enough  to  provide  fast,  finite  corrvergence,  and  small  enough  to  guarantee  optimality.  It  has  been  proven 
that  for  integer  costs  e  <  1/m  is  sufficient  to  guarantee  optimality  [5,10].  For  the  purposes  of  this  paper 
however,  real  costs  were  used.  In  this  case,  it  is  necessary  to  scale  the  real  costs  in  such  a  way  that  they  are 
equivalently  integral.  This  is  equivalent  to  scaling  merely  the  minimum  bid  increase,  which  requires  less 
computation.  In  this  manner,  e  <  0.000 1/m  was  found  to  be  sufficient  to  guarantee  optimality  for  the  real 
costs  used  in  this  application. 

Assignment  using  the  auction  algorithm  requires  two  steps.  The  first  step  is  the  forward  auction, 
where  each  job  is  assigned  to  exactly  one  person.  The  forward  auction  wiU  provide  the  same  one-to-one 
solution  provided  by  Munkres’  algorithm.  The  second  step  is  the  reverse  auction,  where  the  remaining 
71  -  m  unassigned  jobs  wiU  be  ^ropriately  assigned,  so  that  each  person  may  have  more  than  one  job  to 
do.  Each  of  the  forward  and  reverse  auction  steps  is  comprised  of  a  bidding  phase  foUowed  by  an  assign¬ 
ment  phase. 

Before  the  auction  algorithm  can  commence,  a  brief  initialization  is  required.  The  initial  values 
described  are  those  that  are  used  in  this  particular  appUcation.  Other  initial  values  can  be  used,  with  feasible 
ranges  described  in  [10].  At  any  stage  of  the  auction,  there  wiU  be  an  assignment  set  S ,  indicating  which 
person  has  been  assigned  to  which  job.  The  initial  assignment  set  is  triviaUy  chosen  as  the  empty 
assignment  The  price  vector  p  is  initiaUy  set  to  0  for  aU  jobs.  Using  the  formulation  of  the  dual  problem, 
the  initial  profit  vector  can  then  be  set  to 


71.=  .  (14) 

j 

HnaUy,  using  the  definition  of  the  maximal  initial  person  profit,  X  is  initialized  as 

k  =  Tt;  .  (15) 

i 

The  forward  auction  is  fairly  straightforward.  In  the  bidding  phase,  unassigned  persons  i  wiU  submit 
“bids”  for  their  “favorite”  job  y,- ,  as  foUows.  The  favorite  job  y,-  of  person  /  is  that  which  offers  maximum 
value: 


h 


max  r  ,  „  , 

arg  .  {-hj-Pj) 

y  =  1 . n 


(16) 
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That  maximum  value,  obviously,  is 


j  = 


The  best  value  offered  by  any  job  other  than  j-  is 


(17) 


max  ,  , 


(18) 


If  there  is  no  other  job  left  to  assign,  w-  is  set  to  -10000  to  simulate  negative  infinity.  Finally,  the  bid 
person  i  will  submit  for  job  y,-  is  calculated  by: 

=  -/,V,->v.  +  e  .  (19) 

The  assignment  phase  for  the  forward  auction  considers  each  job  j  that  received  a  bid  during  the  most 
recent  tridding  phase.  The  set  of  people  who  submitted  bids  for  job  j  is  represented  by  P(j)  ■  At  diis  point, 
the  price  of  job  j  is  increased  to  the  highest  bid  it  received,  as  calculated  in  Equation  19: 


Pj  = 


max  , 
i  6  PU) 


(20) 


If  j  were  previously  assigned  to  some  r  ,  then  r  becomes  unassigned,  and  j  is  now  assigned  to  the  person 
ij  who  submitted  the  winning  bid.  This  forward  auction  is  continued  until  all  persons  i  are  assigned  to 
some  job  j,-. 

If  there  were  a  tie  for  person  i ,  the  best  value  offered  by  any  job  other  than  j-,  would  be  the  same 
as  V,- ,  which  would  mean  the  bid  in  Equation  19  would  become 


*0)  = 


(21) 


and  thus  the  bid  is  increased  by  the  minimum  bid  increase,  e . 

The  reverse  auction  starts  with  some  assignment  set  S  in  which  each  person  is  assigned  to  a  distinct 
job.  In  other  words,  the  reverse  auction  starts  with  the  S  provided  by  the  forward  auction.  It  follows 
similarly  to  the  forward  auction,  but  it  must  contain  a  mechanism  that  distinguishes  when  a  job  can  be  added 
to  a  person’s  existing  assignment  as  opposed  to  when  that  job  displaces  the  existing  assignment,  thus 
imassigning  any  currently  assigned  jobs. 
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The  bidding  phase  involves  all  jobs  J  that  are  unassigned  under  the  assignment  set  S .  Job  J  selects 
its  “favorite”  person,  ij ,  as  that  which  offers  maximal  value 


•  infix  r  I  w  1 

I  =  1 


(22) 


That  maximal  value  is  reixesented  by 


max 

I  =  l,...,m 


The  maximal  value  offered  by  persons  other  than  ij  is 


(23) 


max 


w ;  =  .  ,  .  .  {-lij-lii}  . 

•'  I  =  l,...,m,  ■' 


(24) 


As  in  the  forward  auction,  if  ij  is  the  only  person  left  to  consider,  co^-  is  set  to  -10000,  or  negative  infinity. 
The  multiassignment  indicator,  or  bid,  is  set  as: 

5  =  P, -©,  +  £}  (25) 

J  ■>  •' 

In  the  assignment  phase,  job  j  is  assigned  to  person  ij ,  and  the  price  and  profit  vectors  are  updated: 

Pj  =  P;-5 

7t,-^  =  +  5  .  (26) 

If  5  >  0  ,  any  job  /  that  was  previously  assigned  to  person  ij  is  unassigned,  leaving  job  )  as  the  only  job 
assigned  to  person  ij .  A  person  ij  has  a  job  j  multiassigned  if  and  only  if  5  =  0 ,  or  equivalently, 
n-  =  X.  In  other  words,  if  the  profit  received  by  person  ij  has  already  reached  the  maximal  person  profit, 
assigning  job  j  caimot  increase  that  profit  Thus  job  j  does  not  offer  more  profit  to  person  ij  than  the 
current  job  assignment  and  there  is  no  reason  to  unassign  those  jobs. 

At  the  end  of  the  forward  auction,  an  optimal  one-to-one  assignment  is  given,  equivalent  to  the 
optimal  assignment  obtained  by  Munkres’  algorithm.  If  a  one-to-one  assignment  were  sought  the  solution 
is  provided  from  the  forward  auction  alone.  At  the  end  of  the  reverse  auction,  aU  jobs  j  are  assigned  to  some 
person  i ,  and  each  person  i  may  have  more  than  one  job  assignment 

It  is  relevant  to  discuss  the  use  of  the  chi-square  statistic  at  this  point  If  the  association  cost  of  job  j 

to  aU  persons  i  =  1 . m  exceeds  the  appropriate  chi-squared  statistic,  then  job  j  is  labeled  as  assigned  to 

no  person  during  the  initialization.  This  excludes  it  from  being  considered  in  multiassignment  in  the  reverse 
auction  algorithm,  while  being  consistent  vwth  the  idea  of  associating  measurements  that  are  most  likely  to 
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have  originated  from  the  same  target.  If  there  are  (n  -  /n  +  i)  such  jobs  j  that  exceed  the  chi-squared  statistic 
for  all  persons,  k  of  these  jobs  will  be  assigned  during  the  forward  auction,  because  each  person  must  be 
assigned  some  job. 
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5.  TARGET  OBJECT  MAPPING  SIMULATION 


A  Monte  Carlo  simulation  of  the  target  object  mapping  problem  was  used  to  compare  the 
algorithms.  TWo  sensors  simultaneously  track  a  set  of  m  targets.  The  sensors’  measurement  errors 
modeled  as  zero  mean  Gaussian,  with  sensor  I’s  error  variance  denoted  by  O]  aixl  the  sensor  2’s  e 
variance  denoted  by  C2 . 

A  set  of  m  targets  is  randomly  drawn  from  a  two-dimensional  uniform  [0,1]  distribution.  These  m 
targets  are  assumed  to  be  observed  by  both  sensors,  and  the  ^propriate  random  Gaussian  noise  is  added  for 
the  sensor  measurement  value.  A  set  of  (n  -  m)  extraneous  targets  are  then  randomly  drawn,  also  from  a 
two-dimensional  uniform  [0,1]  distribution,  that  are  only  observed  by  sensor  2.  The  appropyriate  random 
Gaussian  noise  is  also  added  to  these  taigets  to  provide  for  sensor  2’s  extraneous  measurements. 

The  association  costs,  l-j ,  are  calculated  as  in  Equation  9.  A  chi-square  threshold  corresponding  to  a 
93%  confidence  level  was  used  to  screen  out  unlikely  matches.  If  /,y  for  observation  j  is  greater  than  this 
value  for  aU  observations  i  =  1  ,...,m ,  observation  j  can  be  considered  as  one  of  the  extraneous  observations 
and  automatically  discarded  from  consideration  for  multiassignment  in  the  reverse  auctioa 

Once  the  association  costs  are  calculated,  the  assignment  problem  is  solved  two  ways:  one  solution  is 
obtained  by  Munkres’  algorithm;  the  other  is  obtained  using  the  auction  algorithm. 


17 


I  i  I 


6.  RESULTS 


Experiments  of  such  Monte  Carlo  simulations  were  conducted  using  four  slightly  different  test  sets. 
Within  each  test  set,  11  separate  runs  consisting  of  1000  simulations  each  were  conducted  (se^jRgure  4). 
This  was  to  demonstrate  the  difference  in  the  results  as  the  normalized  error,  a  =  +  O2)  .  ranged 

from  0.001, 0.1, ... ,  1.0.  The  case  in  which  error  is  equal  to  0.001  approximates  the  case  in  which  error  is 
equal  to  zero,  or  when  die  measuremoits  are  very  precise.  The  other  extreme,  when  error  is  equal  to  1.0,  is 
the  case  in  which  the  sensors  are  not  providing  accurate  readings  at  aU.  The  most  important  comparisons 
occur  when  the  error  is  between  0.2  and  0.4,  because,  as  will  be  seen,  this  is  when  correlation  accuracy 
drastically  decreases.  When  the  error  variance  for  sensor  2  is  much  less  than  that  for  sensor  1,  the  error 
variance  for  sensor  2  is  set  to  0.001. 


302976^ 


Figure  4.  Organization  of  Monte  Carlo  simulations. 


An  initial  set  of  experimoits  evaluated  the  performance  of  both  algorithms  for  the  one-to-one 
correlation  problem.  For  such  sets,  m  =  n,  and  the  auction  algorithm  terminates  at  the  end  of  the  forward 
auction  because  aU  perstms  and  aU  jobs  are  assigned.  These  results  show  that  both  methods  provided  the 
same  one-to-one  soluticms,  because  both  solved  the  case  optimally  for  the  calculated  correlation  costs.  The 
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next  set  of  experiments  considered  unequal  numbers  of  observations  for  the  two  sensors.  These  test  sets  are 
summarized  in  Table  2. 


TABLE  2 

Test  Sets:  1000  Simulations  for  Each  a  =  O.OOi,  O.i,  0.2 . i.o 


Test  Set 

SI  Observations 

S2  Observations 

2  2  2 
aj  +a2  =  a 

1 

5 

10 

CT2«0, 

2 

5 

10 

3 

10 

5 

02 

4 

10 

5 

CTj  =  a. 

The  results  shown  below  demonstrate  results  for  test  set  1 ,  but  these  results  can  be  extended  to  include 
the  other  test  sets.  There  are  m  =  5  observations  from  sensor  1  (SI)  and  n  =  10  observations  from  sensor  2 
(S2).  Six  performance  measures  were  considered  important  for  this  case  (see  Table  3).  The  results  of  each 
are  plotted  versus  the  normalized  variance  error,  a . 

TABLE  3 

Simulation  Performance  Measures 


1 .  Probability  of  perfect  assignment 

2.  Probability  of  prime  target  correlation 

3.  Number  of  prime  target  assignments 

4.  Average  prime  target  assignment  costs 

5.  Average  auction  iterations 

6.  Prime  target  assignment  “swaps* 


The  probability  of  perfect  assignment  is  a  sensor-to-sensor  correlation  measurement  This  tells  us 
how  often  each  of  the  SI  observations  was  assigned  to  the  S2  observation  that  originated  from  the  same 
target,  for  each  of  the  five  targets.  In  the  case  of  the  auction  algorithm,  a  multiassignment  was  considered 
perfect  if  the  correct  S2  observation  was  among  those  assigned  to  the  corresponding  SI  observation  for  each 
of  the  five  targets. 
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Test  Set  1 :  S1  =  5,  S2  =  10 
1000  trials 


Normalized  error  ( o) 


Figure  5.  Probability  of  perfect  assignment. 


As  can  be  seen  from  Figure  5,  the  auction  algorithm  offered  significant  improvement  over  Munkres’ 
algorithm  in  perfect  assignment  At  covariance  values  of  0.2  through  0.4,  there  is  as  much  as  a  30% 
improvement. 

The  rest  of  the  performance  measures  concentrate  on  the  more  specific  target  object  mapping 
problem.  In  these,  we  are  concerned  most  specifically  with  one  particular  target,  which  is  referred  to  as  the 
prime  target.  For  the  sake  of  simplicity,  we  assume  the  prime  target  is  the  first  target  The  following  graphs 
depict  the  accuracy  of  the  correlation  of  the  measurements  for  this  specific  target  The  probability  of  prime 
target  correlation  measures  how  often  the  SI  prime  target  observation  and  the  S2  prime  target  observation 
were  correctly  assigned.  For  the  multiassignment,  it  is  enough  that  the  S2  prime  target  observation  is  among 
those  assigned  to  the  SI  prime  target  observation. 
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Figure  6.  Probability  of  prime  target  correlation. 


As  is  seen  in  Figure  6,  the  auction  algorithm  again  offers  significant  improvement  over  Munkres’ 
algorithm.  At  the  most  critical  points,  where  covariance  is  between  0.2  and  0.4,  it  offers  a  10%  to  20% 
improvement  in  prime  target  correlation. 

The  number  of  prime  target  assignments  measures  how  allowing  the  multiassignment  benefited  in 
finding  the  correct  prime  taiget  assignment.  The  baseline  is  the  number  of  times,  over  1000  simulations, 
Munkres’  algorithm  correctly  associated  the  SI  prime  target  observation  and  the  S2  prime  target  observa¬ 
tion.  This  is  compared  to  the  number  of  times  the  auction  algorithm  provided  the  correct  assignment  as  a 
one-to-one  solution.  It  is  also  compared  to  the  number  of  times  the  auction  algorithm  provided  the  correct 
assignment  in  a  jt-to-one  assignment  (multiassignment),  where  k  can  be  2,  3, 4,  5,  or  6. 
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Test  Set  1:  S1  =  5,  S2  =  10 
1000  trials 
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Figure  7.  Number  of  prime  target  assignments. 


Figure  7  shows  that  as  the  covariance  increases,  allowing  the  multiassignment  is  what  gives  the  the  auction 
algorithm  such  advantage  in  prime  taiget  correlation  over  Munkres’  algorithm.  When  covariance  ranges 
between  0.2  and  0.4,  multiassignments  allow  for  up  to  twice  as  many  prime  taiget  assignments  over  unique 
assignments. 

The  average  assignment  cost  of  the  prime  target  was  compared.  For  Munkres’  algorithm,  this  was 
merely  the  correlation  cost  /jy  of  the  SI  prime  target  observation,  and  the  S2  observation  j  assigned  to  it. 
These  values  were  summed  over  the  1000  simulations,  and  then  the  average  was  taken.  For  the  auction 
algorithm,  the  distinct  minimum  and  maximum  SI  prime  taiget  assignment  costs  for  each  of  the  1000 
simulations  were  taken  as  a  baseline.  It  is  intuitively  obvious  that  the  prime  target  assignment  costs  are 
bounded  below  by  zero  and  above  by  the  chi-square  threshold.  Finding  the  average  assignment  cost  was  a 
multistep  process.  In  each  simulation,  the  average  of  the  correlation  costs  l^j  for  aU  S2  observations  j 
assigned  to  the  SI  prime  taiget  observation  was  found.  These  averages  were  summed  over  the  1000 
simulations,  and  the  overall  average  was  then  calculated. 
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Test  Set  1 :  SI  =  5,  S2  =  1  0 
10  00  trials 
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Figure  8.  Average  prime  target  assignment  costs. 


It  can  be  seen  from  Figure  8  that  the  auction  algorithm  has  a  slightly  larger  average  assignment  cost  for  the 
prime  target  than  Munkres’  algorithm.  This  is  most  likely  due  to  allowing  several  assignments,  which  are 
likely  to  have  slightly  larger  assignment  costs  than  the  single  optimum  assignment 

There  were  several  statistics  that  were  compared  to  demonstrate  the  efficiency  of  the  auction 
algorithm.  The  average  number  of  iterations  for  the  forward  and  reverse  auction  iterations  was  calculated 
simply  to  show  that  at  any  given  time,  the  auction  algorithm  does  not  require  a  large  number  of  iterations. 
More  specifically.  Figure  9  shows  that,  on  average,  there  are  never  more  than  five  forward  auction  iterations, 
and  rarely  more  than  two  reverse  auction  iterations. 
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Test  Set  1:  SI  =  5,  S2  =  10 
10  00  trials 


0.001  0.1  0.2  0.3  0.4  0.5  0.6  0.7  0.8  0.9  1.0 

Normalized  error  (  o) 


■3 Forward  Auction 


B  Re  verse  Auction 


Figure  9.  Average  auction  iterations. 


The  number  of  prime  target  swaps  displays  how  often  the  assignment  for  the  prime  target  at  the  end 
of  the  forward  auction  is  not  included  in  the  prime  target  assignment  at  the  end  of  the  reverse  auction.  A 
prime  target  swap  can  mean  that  the  SI  prime  target  and  the  S2  prime  target  were  correctly  assigned  at  the 
end  of  the  forward  auction,  and  then  not  assigned  at  the  end  of  the  reverse  auction.  It  is  equally  likely  that 
the  reverse  is  true,  i.e.,  that  the  SI  prime  target  and  the  S2  prime  target  were  not  assigned  at  the  end  of  the 
forward  auction  and  then  were  correctly  assigned  at  the  end  of  the  reverse  auction.  Figure  10  shows  that 
such  swaps  occur,  at  worst,  in  about  10%  of  the  simulations. 
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Test  Set  1  :  S1  =  5,  S2  =  10 
100  0  trials 
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Figure  10.  Prime  target  assignment  "swaps." 


The  performance  measures  become  a  little  trickier  if  it  is  important  to  assign  the  prime  target 
measurement  from  one  sensor  to  only  one  measurement  of  the  other  sensor.  This  could  happen,  for 
example,  in  case  three  of  our  test  sets.  This  would  correspond  to  a  situation  in  which  S2  obviously  has  a 
larger  error  variance  and  more  measurements  than  SI.  The  primary  concern  in  this  scenario  is  to  associate 
the  prime  target  measurement  of  SI  to  only  the  S2  measurement  that  is  most  likely  to  correspond  to  the 
prime  target.  Obviously,  Munkres’  algorithm  forces  such  a  one-to-one  assignment,  so  the  Munkres’ 
performance  measures  remain  the  same.  The  performance  measure  of  interest  is  the  probability  of  prime 
target  correlation.  For  the  auction  algorithm,  this  can  be  defined  by  considering  a  prime  target  assignment 
as  correct  only  if  the  SI  prime  target  is  the  only  observation  correlated  with  the  S2  prime  target. 
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Test  Set  3:  S1  =  10,  S2  =  5 
1000  trials 
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Figure  11.  Prime  target  accuracy  for  test  set  3. 


Both  performance  measures  are  represented  in  Figure  11.  The  prime  target  accuracy  for  the  auction 
algorithm  is  represented  by  the  bar  that  indicates  the  number  of  times  the  auction  algorithm  provided  the 
correct  prime  target  assignment  as  a  one-to-one  assignment.  The  remaining  auction  results  are  shown  for 
comparison.  For  such  a  definition  of  prime  target  correlation,  Munkres’  algorithm  outperforms  the  auction 
algorithms  significantly,  especially  when  the  covariance  is  between  0.2  and  0.4.  However,  in  this  case,  one 
could  simply  extract  the  one-to-one  solution  from  the  forward  auction  if  one  were  not  interested  in 
allowing  multiassignments. 

The  remaining  performance  measures  can  be  conducted  in  the  same  manner  for  all  test  sets,  resulting 
in  similar  conclusions.  The  average  prime  target  assignment  costs  showed  similar  patterns,  being  bounded 
above  by  the  chi-square  statistic  and  below  by  zero,  with  the  average  auction  cost  slightly  greater  than  the 
average  Munkres’  cost.  The  average  number  of  forward  auction  iterations  approached  six;  the  average 
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number  of  reverse  auction  iterations  rarely  exceeded  two.  The  number  of  prime  target  assignment  swaps 
was,  in  the  worst  case,  nevermore  than  12%. 
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7.  CONCLUSIONS 


This  report  set  out  to  explore  the  use  of  the  auction  algorithm  in  an  application  of  the  assignment 
problem:  the  target  object  mapping  problem.  More  specifically,  a  comparison  of  the  performance  of  the 
auction  algorithm  for  generalized  assignment  and  Munkres’  algorithm  for  one-to-one  assignment  was 
conducted.  This  was  done  in  four  test  sets,  the  results  of  which  were  compared  using  various  performance 
measures  in  an  attempt  to  show  the  problem  from  multiple  angles. 

The  auction  algorithm  requires  considerably  fewer  computations.  The  computational  complexity  of 
the  auction  algorithm  is  only  0{nm\ogm) ,  as  compared  to  Munkres’  algorithm,  which  has  a  computational 
complexity  of  0{m) .  (However,  in  situations  that  are  realistically  considered  in  target  objea  mapping, 
computational  complexity  is  not  a  factor,  because  measurement  sets  are  typically  small  enough  where  such 
run-times  would  be  negligible.)  The  fast,  finite  completion  of  the  auction  algorithm  was  further  quantified 
by  showing  that  the  average  number  of  total  auction  iterations  never  exceeded  eight  iterations  throughout 
the  experiments. 

The  auction  algorithm  is  significantly  more  flexible  then  Munkres’  algorithm.  If  one  is  concerned 
with  the  one-to-one  assignmait  provided  by  Munkres’,  it  is  simple  to  extract  this  solution  from  the  final 
forward  auction  assignment  set  However,  if  one  is  concerned  with  a  target  objea  map,  the  multiassignment 
allowed  by  the  reverse  auction  provides  significantly  better  prime  target  solutions.  This  was  demonstrated 
through  the  use  of  two  performance  measures:  the  probability  of  perfea  assignment  in  a  sensor-to-sensor 
correlation  experiment,  and  the  probability  of  prime  target  correlation  in  target  object  mapping.  As 
covariance  increased,  the  variability  between  the  Munkres’  prime  target  solution  and  the  auction  prime 
target  solution  also  increased,  with  as  much  as  a  12%  variability  for  final  prime  target  assignments. 
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